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UNCERTAIN DYNAMICAL SYSTEMS ~ A DIFFERENTIAL GAME APPROACH 


Shaul Gutman 
Ames Research Center 


SUMMARY 


A class of dynamical systems In a conflict situation is formulated and 
discussed, and the formulation is applied to the study of an Important class 
of systems in the presence of uncertainty. The uncertainty is deterministic 
and the only assumption is that its value belongs to a known compact set. 
Asymptotic stability is fully discussed with application to variable structure 
and model reference control systems. 


1. INTRODUCTION 


In the past two decades an extensive effort has been made, mainly in the 
U.S.S.R., to Improve dynamic performances of linear systems, using the concept 
of variable structure systems (VSS) (ref. 1). Roughly speaking, given a 
linear dynamical system, it is possible to use a "linear" feedback whose gain 
values vary with the state. In the case of linear systems, VSS is related to 
bilinear control (ref. 2); the reader can consult reference 3 for this subject. 
Furthermore, under some conditions, such nonlinear controllers can operate 
against parameter uncertainty and input disturbances (refs. 4 and 5). In 
references 4 and 5, the approach is to find an attractive hyperplane in the 
state space such that the motion there is Independent of the disturbance 
(invariance property). Then, it is possible to study the asymptotic behavior 
of the system in this hyperplane using the usual linear technique. Since 
attractivity is a local property, one has to add conditions that guarantee 
either reaching the attractive hyperplane or approaching the origin outside 
it (in ref. 4 such conditions are called "fall conditions"). However, for 
some multivariable systems this procedure may be too complicated. In addition, 
references 4 and 5 lack a priori conditions for stability. It should be men- 
tioned that in some non-trivial cases it is possible to stabilize a linear 
system in the presence of parameter uncertainty using a linear feedback 
(ref. 6) by modifying the Riccati equation. Although the feedback control is 
simple, there are no a priori conditions for stability. In the case of linear 
time invariant systems with some unknown parameters, it is useful to use an 
adaptive model reference scheme (refs. 7 and 8) which assumes some "matching 
conditions" (ref. 9). 

In this article, we develop stabilizing controllers for a class of non- 
linear systems homogeneous in the input, in the presence of uncertainty. We 
consider the uncertain system from the viewpoint of a conflict between uncer- 
tainty and controller. We associate with the dynamics a cost function and 
find a saddle point for finite transfer time. In checking asymptotic 



properties of the system we note that the saddle point controller may be dis- 
continuous. Thus, we use "generalized dynamical systems" theory to define a 
solution of the resulting discontinuous dynamical system (refs. 11-12; see 
also 13). Some results with respect to nominal linear systems (i.e., the 
system without uncertainty is linear) are reported in reference 14. Stability 
and optimal control for the nonlinear case without uncertainty are studied in 
reference 15. It is interesting to note that our conditions on the system's 
structure and the "invariance condition" of references 4 and 5 are both 
equivalent to the "matching conditions" (refs. 7-9). The main drawback of 
the present method (as in optimal control) is the necessity to measure the 
complete state vector. 

In section 2 we formulate and solve a simple differential game for finite 
terminal time. Motivated by the saddle point strategy, we study in sections 3 
and 4 the asymptotic behavior of uncertain systems. In section 5 we apply 
the results to nominal linear systems with special attention to VSS. Appli- 
cations to model reference control in the presence of uncertainty are discussed 
in section 6, 

I am grateful to Prof. G, Leitmann for his critical reading and encourage- 
ment, and to Prof. E. Polak for drawing my attention to reference 5. 


2. A SIMPLE DIFFERENTIAL GAME 


Consider the dynamics 


X = f(x,t) + B(x,t)(u + n) , \ 

uGU = {u;u'R”^u < p^(x,t)} 

( 2 ) 

nGV = {ri5n*R”’^n ^ p^(x,t)} 


where xGR”, u,r|Gfl”', B(*) is continuous on (R ' , f(*) will be speci- 

fied later, R = M'M is a constant positive definite symmetric matrix, and 
p(*) 1s a continuous scalar function on ^ . With (l)-(2) vre associate 
the cost 


d “ f ^ g(x,t)dt 
t 

o 


(3) 


where T is fixed and g(») will be specified later. For system (l)-(2) 
we seek a saddle point strategy pair {p’*'(* ) ,e*(* ) ) in the class of strategy 
pairs {p(0,e(*)) satisfying the hypotheses of reference 16, such that 
u(t) = p(x(t),t), n(t) “ e(x(t),t); and V(x^,t^)Gfl^x(-»,T] 

j(x^,t^,p*(-) ,e(*)) < d(x^,t^,p*(*),e*(*)) < j(x^,t^,p(*),e*(»)) (4) 
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In order to find {p*(* ) ) ) , we restrict f(*)i b(*) as follows; 

AeBwnption 1: The functions f(0» g(*) are on 

Since U and V are identical sets, we expect (4) to be satisfied af 
p*(i) a Then, equation (1) becomes x* « f(.t'',t) and the cost (3) is 

evaluated ajong x*(*); namely J « J(xQ.to,p*(0 ,e*(0) ^ u*(xQ,to). Since 
f('), g(0 are C^, the above cost is c’ with respect to (xo,to). 

Using Isaacs' equation (ref. 17), 

Min Max TgCx.t) + grad u*(x,t) • ^f(x,t) + B(x,t)(u + n)^l “ 0 , 
u6U nev L ' 'J 

we find 


p*(x t) “ -e*(x t' = ~D (x t)M' u’^(x,t) , t)'t >V 

p vx,t; e o.,c, P^x,t;M ||„b. (x,t)grad' u*(x,t)ll 

{p*(* ) »e*(* ) } is any admissible pair V(x,t)S.yV' 

.4 i {(x,t);B' (x,t)grad’ u*(x,t) = 0} 


(5) 


Remark 1: If (2) is replaced by 


U « {uGfi"*: 


V = {qeiR 


,m 


< p^(x,t)} 

< p^(x,t)) 


( 2 ') 


then {?*(•) $e*(* ) ) becomes 

p^^Cxjt) = -e^*(x,t) = -pj^(x,t)sgnjbj^' (x,t)grad’ o*(x,t)j V(x,t)^.4^ 

) } is any admissible pair V(x,t)e.4^ (5') 

{(x,t) :b^* (x,t)grad' u*(x,t) = 0} , B ^ |^bj . . . b^J . 

We conclude with 

Theorem 1: Consider the differential games (1), (2), (3) and (1), (2'), (3), 

The strategy pairs {p*(0 ,e*(*)) given by (5) and b’), respectively, are 
saddle points on (R*^x(-«>,Ti . 

Now that theorem 1 is established, the application to the control of 
uncertain systems is straightforward. If a system of the form x = F(x,t,u) 
has an uncertainty (in the parameters, input or both) that can be transformed 
into a system of the form x = f(x,t) + B(x,t)(u + q) and if the controller 
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u uses p*(*) given by (5) or (5'), he Is guaranteed the c.ost (3) evaluated 
along solution of x “ f(x,t). Note that the identity of sets U and V is 
essential for estahl Islilng the saddle point. Practically speaking, after 
verifying the above form, we bound the uncertainty by V as in (2) or (2'), 
even if we have to be conservative. Then we define U to be identical to V 
as in (2) or (2') . 


3. STAIliLlTY OF A CLASS OF UNCERTAIN SYSTEMS 


We now turn our attention to the asymptotic hehavlor of (1). We first 
relax assumption 1 by making the following assumption. 

AsaumpHon P.: The function f(*) is continuous on and f(o,t) = o Vte(R_J^. 

We also need 

Aeauimption S: The origin x - {0} Is uniformly asymptotically stable in the 

large for x = f(x,t), such that there exists a function <11^ 

satisfying (ref. 18); 

1. u(x,t) is positive definite (p.d.): H a continuous, nondecreasing 

scalar function a(0 with a(0) = 0, such that Vted?^ and Vxfiidl'’, x 0 

0 < a(llx[|) < u(x,t) 

2. u(x,t) has an "infinitely small upper bound": 51 a continuous non- 

decreasing scalar function g(‘) with 3(0) « 0, such that VtGdl], 

u(x,t) < B(Ilxil) 


3. a(lixll) “ as llxll ■+ “ 

4. W (x,t) 4“+ grad u • f is negative definite (n.d.). 

0 at 

Aaawnption 4: Admissible strategy e ( • ) : '>■ V is continuous on and 

piecewise continuous on any compact subinterval of 

Motivated by (5) and (5') we assoicate with (2) and (2‘), respectively, 
the feedback BCrategiea t U given, teapectively, by 


p(x»C) 


-p (x, t)M' 


MB' (x,t)grad' u(x,t) 
IjMB' (x,t)grad' u(x,t)ll 


V(x,t)f/, 1 


(uSU •= {ueil’":u'R“^u < p^(x,t)> V(x,t)€,l 


( 6 ) 


{ (x,t) :B' (x,t)grad' u(x,t) = 0} 


(6a) 
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and 




-p^(x,t)sgn|b^' (x,t)grad' u(x,t)J V(x,t)^^,4^ 
- {Uj^QS^;|u^| < p^(x,t)} V(x,t)e./t^ 


( 7 ) 


,A^ ^ { (x,t) :b^’ (x,t)grad' u(x,t) » 0} , ie{l,2, . . . , m) , (7a) 


where the are the columns of B> 

We now have 


Theorem 2: Consider the dynamical systems (l)-(2) and (l)-(2'). If we sup- 

pose that assumptions 2-4 are met, then there exists a feedback control p(*) 
satisfying (6) and (7), respectively, such that the origin x ■ {0} is 
uniformly asymptotically stable In the large for all admissible disturbances 

e(») . 


Proof: Since jJ(*) is discontinuous and hence considered not unique, 

equation (1) becomes a generalized dynamical system (refs. 11 and 12), 

x£E(x,t) (8) 

where the set valued function £(•) Is given by 

E(x,t) - {f(x,t) + B(x,t)u + B(x,t)e(x,t) !u « p(x,t)} (8a) 


It can be shown (see appendix) that 


1. E(x,t) is convex V(x,t)QR”xtf?j^ 

2. E(x,t) is compact V(x, t)Gfl”x(R} 

+ 

3. E(*) is upper semicontinuous on 


Thus, given any (Xg , t^ )efl”x(R| there exists at least one solution of (8). 
That any such solution can be continued^ on Is one of the consequences 

of the properties of the following Lyapunov function. Let 
of assumption 3 be a Lyapunov function candidate. We now show that uox(t) 
decreases along a solution x(*) of (1) generated by {p(*),e(*)}* 


^At points of discontinuity of e(x,*), solutions can be joined in the 
usual way. 
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For (x(t) in system (l)-(2),2 

W(t) ^ + grad u » ft 

9t 

“ •” + grad u • + Bj) + BeJ 

9u . - 

" + grad u • f - p 

- W^(x(t),n) - pHMB* grad' u!l + grad o Be 

< W^(x(t),t) - ptiMB* grad' ull + pH MB' grad* ull 

- W^(x(t),t) < 0 

For (x(t) ,t)e,y4' but x(t) 0, 

W(t) - W^(x(t),t) < 0 . Q.E.D. 

Similar results are obtained for system (l)-(2’>. 

Remavk 2: If in equation (2) 

U = {u:u'R”*u < p^^(x,t)} 

V - {n:ti’R”^n < p^^(x,t)} 

then we use p (x,t) in (6), where p (x,t) > p (x,t). A slrallar statement 
holds for (2*)“ (7). “ 

Integrating W(t), we find 

Corollary 1: The average measure of deviation from the origin along a solu- 

tion x(‘)![to,“] -► fl", x(to) = x^, generated by {p(*),e(0) is 

/”■ W^(x(t)>t)dt < u(x^,t^) . 

^o 

4. APPLICATION TO PARAMETER AND INPUT UNCERTAINTY 

Consider the uncertain dynamical system 

ft =» f(x,t) + 6f(x,t,v) + B(x,t)u + C(x,t)w (9) 

^For simplicity we drop function's arguments. 


^rad uBM'MB* grad* u 
II MB* grad' oil 
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where f, BQfi , Oefl , ued? , 6f(*) Is continuous. The uncertainty 

vector functions v(* ) w(* ) -*■ are continuous and satisfy 

(v,u)€fi, where 


n & VGSI^ : 


< 1 


1 , 2 , 


.q 


Iwll < p 


w 


( 10 ) 


We now require 

Aeewtption 5: For all (x,t)Gfl”x(R^ there exists a continuous vector function 

h(x,t,v)efl"' and a continuous matrix function D(x, such that 


(I) fif(x,t,v) - B(x,t)h(x,t,v) 

(II) C(x,t) “ B(x,t)D(x,t) 


( 11 ) 


We refer to (l)-(ll; as "matching conditions". 


Hemavk 3: The matching conditions are properties only of the system’s struc- 

ture. They guarantee that the controller u Influences the dynamics In 
equation (10) as "well" as the disturbance 6f + Cw does. 


If (11) is satisfied, (10) becomes 

* - f(x,t) + B(x,t)(u + h(x,t,v) + D(x,t)w) (12) 

Denoting h + Dw by Pi equation (12) reduces to the form of (1). 

Remark 4: If x “ f(x,t) is not asymptotically stable, we have to stabilize 

it via B(x,t)u. The subject of stabilizing a system of the form 
ft » f(x,t) + B(x,t)u is considered in reference 15. 


Applying theorem 2 to equation (12) , we find 

Theorem 3: Consider the uncertain system (9)- (10) and suppose assumptions 2-5 

are satisfied. If p ( • ) U is given by (6) with 

p(x,t) > p„ + Maxllh(x,t,v)II , u ■= p(x,t), then the origin x = {0} is uniformly 
asj'mptotically stable in the large for all admissible (v,w). 


5. APPLICATIONS TO NOMINALLY^ LINEAR SYSTEMS 


5.1 Parameter Uncertainty 

Consider the uncertain system (9) with f(x,t) k Ax; that is 

ft “ (a + AA(v))x + Bu 


^That is, without uncertainty the system is linear. 
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where Aor”^", ore constant matrices t A is asymptotically stable: 

all its eigenvalues have negative real parts, A ^ [a^); AA(v) ^ 

“ij “ constant, 1 ,Jg{ 1,2, . . ,, n}. The uncertainty vector function 

v( ■ ) la continuous and satisfies v6JJ, where 


n £ veR^i: 


V (• 

Ij 


1 , 1,J6{1,2, 


. ,n} 


Let matching conditions (11) be satisfied: 

There exists a continuous -*■ (R*"^” such that VveR 

AA(v) •» BF(v) 


The state equation becomes 


A ■ Ax + b{u + F(v)x) 
»j Ax + B(u + n) 


Applying the results of section 3 (eq, (6) with R - I, u(x,t) - x'Px), we 
find a stabilizing feedback control p (• ) siR^xdii -► <r"', u(t) « p(x(t),t), 
satisfying 


where 


P(x,t) 


( -MaxllF(v)xll (x,t)^^ 

ilSu “ |ue(R"':llull < Max|jF(v)xll| (x,t)e,/r 


(13) 


PA + A'P + Q - 0 , Q - Q* > 0 , and ,/V A {(x,t);B'PX - 0} 


Remark S: Here the origin is an equilibrium point in the usual sense, since 

1^ p(x,t) ® 0. This holds in the following two examples as well. 


5,2 System of Section 5.1 in Companion Form with Single Input 


Let 


S ■ (a + AA(v))x + bu 


k 

AA(v) - 2 A^v^(x.t) 
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where * 

r 


0 0 


0 

1 


-ai -02 -B3 


• f • 


» • § 

• • • 

• « • 

* • • 

« » « 


0 

0 


-a 


A. - 



0 « • » 0 0 • < • 0 


Oj “ constant, J ■ 1,2, . . n 

“ constant, 1 ■ 1,2, . . . , k; k < n 
|v^(x,t) I < 1 

Here, F(v) ■ c*(v)x where c'(v) • [oiVi . , . . 

Equation (13) becomes 


p(x,t) 


-Max [c' (v)x]sgn Tf 'x V(x,t)tf,yV' 
ueCuGfl^iluj < Max [c'(v)x]} V(x,t)e^ 

|Vi|<l 


where it is the n-th column of the symmetric matrix P satisfying 
PA + A*P + Q « 0, Q ■ Q' > 0, and .4 - {(x,t):TT'x - 0). 

/i A 1/2 

Remca*k 6: Note that Max [c* (v)x] < I ^ llxll 

|vi|<i Vfrf V 

Equation (14a) subject to remark 6 yields one possible solution for 
A second one is found by noting that 

Max [c’(v)x] - a . Max (v x.) « I 


(14a 


“^In the terminology of section 5.1, ^ i ■ 1,2, . . ., n. 


9 


* 



il 


r 


Thus, (x,t; )€,/♦; 

p(x,t) ■ - 2^ “ill'll®®” “ *■ “i’*! '’8« 

a|“iCi • • • 

whore 


' ^ ~ sgn x^n'x 

We conclude that 


p(x,t) - 

K(0 - 




1 


m 


t./V " 


K(Ox 

f“l^l ' • * “n^n^ 

-sgn x^ir’x V(x,t)^,4 

YieCY^efliijY^I < 1) v(x,t)ej 

{(x,t) ift'x ■ 0} , 


(14b) 


X is the n-th column of P, PA + A*P + Q“0, Q“Q' Is any positive 
definite matrix. 

Example 1: Let with 



where Aai aiVj, |vi[ < 1, cti « constant. We assume that 



has all its eigenvalues in the left half plane (otherwise It must be stabilized 
by linear feedback). Equation (14b) becomes 

p(x,t) * K(C)x "[oti?! I oj 


where 5i(x,t) ■ -agn(xiTr'x) , 
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I£ D ^ ^ n^'UD^", then 

x£Di :p(x,t) 


jtfSD2:p(x,t) 



where {Dj,D 2 ) is defined in figure 1. 


Example S: Let xefl^ with 


* 


“o 

-ai+Aai 



u 


where Ao^ ■ oiVi, [v^l < 1, ■ constant, i ■ 1,2. As in example 1, let A 

have all its eigenvalues in the left half plane. Equation (lAb) become'^ 


P(x,t) 


K(5)x « [aieiia2C2] 



where “ - Bgn(x^it'x), i - 1,2. 

If A then 


xSDi :p(x,t) 
xeD2?p(x,t) 
xe 03 :p(x,t) 



a 

a 

■^r 

-X2. 


where {Dj,D 2 ,D 3 } Is defined in figure 2. 


5.3 Variable Structure Systems 

An alternative way to stabilize the systems of sections 5.1 and 5.2 is 
as follows: 

Let 


i « (a + AA(v))x + Bu 


(15) 
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where A and B are constant matrices. As before, let 

AA(v) - BF(v) (15a) 

where vefl is the parameter uncertainty vector with 

n k I < 1 ; l,j » 1,2, , , .,n) . 

We wish to use a stabilizing control of tha form 

u - K(C)x 

where Sen Is the control parameter vector, and S(*) *+• That Is, 

we use a "linear** feedback whose **coefflclents" vary with the state and time. 
Using (15a) and (15b) in (15), we find 

fc - Ax + b(k(S) + F(v))x (16) 

Equation (16) can always be written in the form 

k ■ Ax + M(x)(S + v) (17) 


where M(x) has the proper dimension. 


Since equation (17) has the form of (1), we can use our previous results. 
In particular, consider the system of section 5.2. Here, 


F(v) >= [ajvi . . . a^vj 
K(S) » [ajSi . . . 


M(x) 


O 


(17a) 


(17b) 


laixi . . . a^x_ 1 
L " n n J 

A stabilizing control p (• ) S(t) = p(x(t),t) is found from (7) 

-sgn(x^Tr'x) V(x,t)?^.4' 

<1} v(x,t)e,4' 

where ir is as in section 5.2. As expected, this result agrees with (14b). 


p(x,t) “ 


(18) 
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5»A A Simple Input Disturbance 

Let ft • Ax + Bu + Bv, V • {villvll < Pv ■ constant}, A,B are constant 
matrices, and A Is asymptotically stable. Choose U - {utllull < Py , >0^). 

Equation (6) becomes 

R* Pv 

p(x,t) = "Py 1lB“’Txr V(x,t)^./V == {(x,t)sB'Px= 0} 
where PA + A'P + Q » 0, Q ■ Q' >0. 

Remark 7: Here the origin Is not an equilibrium state in the usual sense. 

Compare with remark 5. 

Remark 8: It a system has both input and parameter uncertainty, we sum the 

corresponding "p s." 


5.5 An Extension 


In the previous sections we assumed that the nominal matrix A is 
asymptotically stable (i.e., all its eigenvalues have negative real parts). 
Here we show a way to stabilize A^ and simultaneously to overcome the 
uncertainty. Consider the nominally time-invariant linear dynamical system 
(9)-(12) with f(x,t) “ Ax, v ^ h -i* Dw; that is, 

' X = Ax + B(u + v) 

■ x(t^) » x^ , tG[t^,«] ’ (19) 

JIull < p^(x,t) , llvll < p^(x,t) , 

where A and B are constant matrices. Now consider a constrol strategy 

p(*) (R’" such that 

+ 

1 R'Px 

( -L B*Px ~ p (x,t) iijjipv'll '^(x, t)^,y|f' 

u IIB Fxll ^20) 

u6{uefl'":||ul| < p^(x,t)} V(x,t)G^' 

where 


J'= {(x,t):B*Px - 0} 

PA + A'P - PBL"^B'P + Q = 0 , 


(20a) 


L is a constant mxra p.d. matrix, and Q is a constant nxn positive semi- 
definite matrix. 


%e keep iu mind that other methods to stabilise A are available, for 
examp] e pole placement. 
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AeBumption 6: 
Aaaumption 7: 
AaaumpHon 8: 
Note: If q 


{F,A,B}i Q ■ F*F, Is completely controllable and observable. 
F is an £xn matrix and £ + m > n. 

The matrix [F'|PB] has full rank, 
is p.d., assumptions 7 and 8 can be dropped. 


Theorem 4: Consider the dynamical system (19). Suppose that assumptions 4 

and 6-8 are met. Then there exists a control function p(» ) -► tfl”* 

satisfying (20) with p„(x,t) > Py(x,t) V(x,t), where u(t) ■ p(x(t),t), such 
that the origin x » {oT is uniformly asymptotically stable in the large for 
all admissible disturbances. 


Proof: It is similar to the proof of theorem 2 with u(x,t) ■ x'Px as a 

Lyapunov function. See also section 5 of reference 19. 

Example 3: Consider the system of section 5.2. Using (20) and (14b) we have 

p(x,t) - + K(fi)Jx (21) 

where 

K(n) « l^ajHi . . , a^n^J 


t -8gn(x Tt'x) V(x,t)??.yV 

, , (21a) 

n^G{rij^e(R’ < 1} v(x,t)e,/K 

jV ^ {(x,t)!Tr'x s 0), IT is the n-th column of P, PA + A'P - PBL“^'P + Q = 0; 
Q = Q’ , L » L' are p.d. 

Example 4: Let xBR^ with 


where 



Choose 



q > 0 . 
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Then, by (21a), 


thus 



It Is evident that assumptions 
We further choose q - 4. 

xeDi : p(x,t) 
xED2:p(x,t) 

xgD3:p(x,t) 

where {01,02,03} is defined i 
is 1. 


1-8 are met. 

Using (21) we find 



r . 1 

I 2 + ot 1 1 2 - 02 J — 

^ ^2. 


figure 2, and the slope of 


{x:u’x 


0 } 


6. MOOEL REFERENCE CONTROL IN THE PRESENCE OF UNCERTAINTY 


In many applications it is convenient to have a given system follow an 
ideal model from an input-output point of view. Suppose a nonlinear system 
has parameter uncertainty and we wish it to follow its nominal response. 
Following the usual scheme of "model reference control," we write the equa- 
tions of the system (plant) and the model, respectively, as 

X = f(x ,t) + 6f(x ,t,v) + B(ii + r) 

P P P (22) 

X = Gx + f(x ,t) - Gx + Br 
m m p p 

where r is a reference signal, is constant, and is any 

constant matrix with all its eigenvalues in the left half plane. Let 

e = X - X . Then 
p m 

e = Ge + 6f(Xp,t,v) + Bu (23) 
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If "matching conditions" (11) are satisfied, equation (23) reduces to the form 
of (12), and theorem 2 is applicable. The block diagram for this situation 
is given in figure 3, with the choice G ■ -al and Q ■ 61, 

Remark 9: Note that as e 0, the model description approaches the desired 

nominal system 


X = f(x ,t) + Br (24) 

m m 

Remark 10: Since, In general, Xp does not approach zero, the origin e <= {0} 

in (23) with the feedback control shown in figure 3 is not an equilibrium 
state in the usual sense. (Compare with remarks 5 and 7.) 

Remark 12: In the light of (24), it is possible to design the model using 

any convenient method, and then to use an additional feedback to overcome the 
uncertainty. 

Remark 12: Finally note that the "Variable Structure Model" in (22) permits 

us to drop the necessity to know the Lyapunov function u(*) in assumption 3. 


CONCLUSIONS 


In this paper some results from the theory of differential games and 
Lyapunov stability of generalized dynamical systems are combined to produce 
simple results concerning a class of uncertain dynamical systems. The basic 
assumption on the system’s structure is the "matching condition" which is 
common in adoptive schemes as well. The basic feature of the present approach 
is the possibility to steer a system as 3 nnptotically to its nominal behavior 
against any bounded uncertainty. The extension of this theory to systems with 
incomplete state measurement is left for a future investigation. 
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Figure 1.- Example 



K 
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Figure 2.- Example 


-Ge +/{x„,t) + Br 
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Figure 3.— Model reference scheme. 




APPENDIX 


DIFFERENTIAL EQUATIONS WITH DISCONTINUOUS R.H.S. 


A.l Some Reaulta from the Theory of "Generalized Dynamical 

Systems," (Ref. 11) 

Definition 1: The diotanae between a point xefl*' and a set A€(H*' is defined 

by 

d(x,A) “ infdix - all :aeA) 


Definition 2: The oeparation of set A from set B is defined by 

d*(A,B) ■ sup{d(a,B) :a£A) 


Definition 2: The variable set E(a)C(R*', said to be upper aemi- 

QpntinuouB at Op, if for every 6 > 0 there exists some neighborhood 
N(Oo) of <*o such that Vo6N(ao) 

d*(E(o().E(a^)) < 6 

In other words, E(*) la upper semicontlnuous at a point, if its separation is 
continuous there. 


Definition 4: 
Let 


Let c = {x(t) ;x: [t ' ,t"l -► dl'^} be a curve defined on 


y(t^) 


x(tj^) - x(tjj) 

t. - t 
1 o 


t ,t€{t’,t"] , 
o 1 


[t»,t"]. 


The set of all yo^fl” such that there exists a sequence (t^^}, 
i “ 1,2,3 ., . ., t^ -»■ to, i> to, and lira y(ti) = yo is called the con- 

tlngent derivative of c at xCt^,); at x(t) it will be designated by 
D x(t). 

Definition 5: An expression D*xCE(x,t), where the set E(x,t) depends on 

(x,t) and is defined on is called a contingent equation. 


Definition 6: A solution of D*xcE(x,t) is any curve 

c « {x(t) :x(0 ! [f ,t"] •+ S{^) such that 


1. x(») is absolutely continuous 

2. x(t)eE(x(t) ,t) for almost all te[t*,t"]. 


Theorem A, 1: Let E(x,t)c<R*^ defined on some compact neighborhood NCx^jt^) 

be compact, convex and upper semicontlnuous. Then there exists at least one 
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Bolutlon to the above contingent equation, passing through a given point 
(xo»to) And this solution can be continued until reaching the boundary of 
ITCxottp) • 


A. 2 Existence of a Solution to Equation (8) 

1. Clearly, at a point (x,t)6^t', the set E(x,t) is a point In and 
E(*} Is continuous there; thus, the usual existence theorem holds. 

2, At a point (x,t)e./l, (see fig, A-1), convexity and compactness ore 
trivial by construction. To prove upper semicontinuity, let ^ ( • ) « 
be given by 


(j)(x,t) « f(x,t) + B(x,t)e(x,t) 
(1) (xi,ti)$t>' (fig. A-l). 

Since E(X|,tj) Is a point in 


d*(E(xi,ti),E(x,t)) - d(E(xi,ti),E(x,t)) 

“ InfH (x,t) “ (j>(xi,ti) f B(x,t)u 
tJeU 

- B(xi ,ti)f>(xi ,ti)ll 

< Il4>(x,t) - (|)(xi ,ti.)ll + llpB(x,t) - pB(xi,ti)ll 
^ llA^lll + llpABill 


(11) (X2,t2)e^' (fig. A-1). 


d*(E(X 2 ,t 2 ) ,E(x,t)) = Sup Inf Il4>(x,t) - 'f(X 2 ,t 2 ) + B(x,t)u - B(x 2 ,t 2 )u 2 ll 

U 2 SU u£U 

< llA(j) 2 ll + Sup Inf llB(x,t)u - B(x 2 ,t 2 )u 2 ll 

U2GU nsu 

“ II A<|) 2 ll + Sup Inf llB(x,t)(u - U 2 ) + AB 2 U 2 H 
U 2 SU uSU 


< !lA(;) 2 ll Sup Inf llB(x,t)!l II u - U 2 ii + II AB 2 II 
U2cuueu *- 

= llA^2ll + Sup|llAB2ll II U 2 II 

+ llB(x,t)ll Inf {II u - U2II ; u€U} :u2Guf 



= II A(fi 2 ll + II AB 2 II SupCII U 2 H supSU) 


“ If A^2ll II P^®2ll 
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(111) since p(*)» 4>(') and B(*) are continuous, given any 
6^, 6i > 0, 3c 1 , Cl > 0 such that 

II (x,t) - (xi,ti)ll < Cl "* llA4iiII < 6i 

II (x,t) - (xi,ti)|l < Cl •♦llpABill < 6i . 

Thus, given any 6 > 0 choose any 6i 5i > 0 such that 6] + 6i “ 6. 

Then 3e ■ Mln{ci,2i} such that 

II (x,t) - (xi,ti)ll < c ■» d*(E(xi ,ti) ,E(x,t)) < llAifill + llpABiH < 6i + 2i » 6 . 

A similar result holds for (x 2 ,t 2 )« We conclude that the separation d*(*) Is 
continuous, which Implies that E(») Is upper semlcontlnuous. 
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